Control of open quantum system dynamics 



O 

o 
o 

(N 



oo ; 
o . 
o 
o 

:^ 

Oh! 

> ■ 

a 

^ : 



Seth Lloyd'l' and Lorenza Viola 
d'Arbeloff Laboratory for Information Systems and Technology, 
Department of Mechanical Engineering, Massachusetts Institute of Technology, 
Cambridge, Massachusetts 02139 

We investigate the control resources needed to effect arbitrary quantum dynamics. We show that 
the ability to perform measurements on a quantum system, combined with the ability to feed back 
the measurement results via coherent control, allows one to control the system to follow any desired 
open-system evolution. Such universal control can be achieved, in principle, through the repeated 
application of only two coherent control operations and a simple "Yes-No" measurement. 

03.65.Bz, 05.30.-d, 89.70.+C 



Ever since the discovery of quantum mechanics more 
than a century ago, the problem of controlling quantum 
systems has been an important experimental issue . A 
variety of techniques are available for controlling quan- 
tum systems, and a detailed theory of quantum control 
has been developed 1^,^ . Methods of geometric and co- 
herent control are particularly powerful for controlling 
the coherent dynamics of quantum systems In 
coherent control, a series of semiclassical potentials de- 
scribed by Hamiltonians {Hi} are applied to the system. 
A basic result in coherent control is that, for a finite 
dimensional quantum system, only a small set of Hamil- 
tonians is required to enact any desired unitary transfor- 
mation on the system |^,^ . In general, only two different 
Hamiltonians will suffice to achieve such universal control 
Thus, arbitrarily complicated time evolutions can be 
built up out of simple building blocks. 

In this Letter we investigate the corresponding ques- 
tion for open-system, incoherent dynamics. Can an arbi- 
trarily complicated open-system dynamics be built up by 
applying coherent control together with only a few basic 
open-system operations? Unlike the case of Hamiltonian 
dynamics, where complete control can be attained purely 
in terms of open-loop manipulations as implied above, 
this turns out to be possible only if closed-loop control 
{i.e., feedback) is allowed. We show that only one sim- 
ple coupling to a measurement apparatus, combined with 
the ability to coherently manipulate the system and feed 
back the measurement results by the repeated applica- 
tion of a few basic control operations, allows one to enact 
arbitrary open-system dynamics. 

Let us first review the basic result of coherent 
control theory mentioned above. Consider an n- 
dimensional quantum system, S, and suppose that one 
can apply potentials corresponding to a set of Hamil- 
tonians {ibiJi}, so that one can apply unitary op- 



erators of 



the form 

iH2At„ 



JHuH2]At'' 



Note that 
+ 0(At3), 



where [Hi,H2] is the commutator of Hi and H2. Re- 
peating this procedure shows that applying Hamiltonians 
from the set allows one to enact any coherent evolution 
of the form e~'"^*, where A belongs to the algebra gener- 
ated from the set by commutation. The time evolution is 



stroboscopic, matching up to the desired one at discrete 
intervals, and approximate. But the error of approxi- 
mation can be made as small as desired by making At 
sufficiently small. Since typically only a small number 
of Hamiltonians (two, e.g.) are required to generate all 
possible Hamiltonians via commutation, arbitrary coher- 
ent transformations can be built up from a small set of 
simple building blocks. This coherent control technique 
is open-loop because no information about the state of 
the system is required to enforce the desired dynamics. 

Now consider open-system dynamics. The simplest 
way to describe an open quantum system is to embed it in 
a closed quantum system. Let the quantum system and 
environment be described by a joint density matrix psE- 
The time evolution of psE is given by a unitary trans- 
formation PSE ^ UpseU^. Before the transformation 
the system on its own is described by a reduced density 
matrix ps = tiEPSE- Afterward, its state is IyeU pssV^ . 
It is then immediately clear that if one has the ability to 
enact any coherent transformation on the system and en- 
vironment taken together, then one can enact any desired 
open-system transformation of the system on its own . 

In general, however, one does not have control over 
the system's environment, but only over the system it- 
self. If the system and the environment are initially un- 
correlated, so that pse{^) = Ps ® Pe, the time evolution 
of S can be described by a completely-positive, trace- 
preserving map Ps ^ Y.k ^kPsA\, where Y.k = 1 
and the so-called Kraus operators Ak can be derived 
from the embedding of the previous paragraph 0. The 
most general infinitesimal limit of such a time evolution 
is given by the Lindblad equation [p|: 



dps 
dt 



= [H,ps] 



{f}f,ps + PsF}f,-2F,psF}) 



(1) 



where H = W is the effective system Hamiltonian (the 
natural Hamiltonian possibly renormalized by a Lamb- 
shift term), {Fi} is a basis for the space of bounded 
traceless operators on S, and A = = {a.y } is a positive 
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semi-definite matrix. After diagonalizing A, Eq. (P can 
be cast in the equivalent canonical form 




-\Y. {^l^kPs + PsLlLk - 2LkPsLl) , (2) 

k 

for a set of bounded, traceless Lindblad operators {Lk} 
. The Lindblad equation is a Markovian master equa- 
tion that defines a quantum dynamical semigroup: in- 
tegrating the Lindblad equation over time t defines an 
open-system transformation At such that A^Ag = At+s 
for t,s>0. 

Suppose that, in analogy with the infinitesimal open- 
loop prescription of the closed-system case, one attempts 
to build up arbitrary open-system evolutions by applying 
coherent operations associated with Hamiltonians {Hi} 
together with some set of open-system infinitesimal op- 
erations described by Lindblad operators {Lk}- Clearly, 
the implementation of the coherent part of the dynam- 
ics, corresponding to if, poses no problem. However, one 
quickly arrives at an impasse while trying to enact the 
open-system operation corresponding to an arbitrary A, 
as the infinitesimal transformations Aa* are not invert- 
ible in general. This has a drastic effect in determining 
the set of matrices A that can be reached by composi- 
tion of infinitesimal open- loop transformations. If we can 
apply infinitesimal operations corresponding to two dif- 
ferent Lindblad equations specified by A and A', then we 
can generate an infinitesimal operation corresponding to 
A -I- A'. But it is not in general possible to build up an ar- 
bitrary positive semi-definite matrix by adding together 
a finite set of positive semi-definite matrices. Indeed, it 
has been shown recently that even in the case of a sim- 
ple two-state quantum system a continuous set of dis- 
tinct non-unitary open-loop transformations is required 
to generate an arbitrary Markovian dynamics . 

Turn now to closed-loop control. In closed-loop con- 
trol one performs measurements on the system and feeds 
back the results of these measurements by applying op- 
erations that are a function of the measurement results. 
Although both the system and the measurement appa- 
ratus are quantum-mechanical in principle, the feedback 
operations we consider here involve feeding back classi- 
cal, not quantum information. The case of feeding back 
quantum information via fully coherent quantum feed- 
back was addressed in . Note that closed-loop control 
is intrinsically non-Markovian in that the feedback loop 
retains memory of the system's state at previous times 
[ prf . As will now be shown, such non-Markovian feature 
is essential to allow for the generation of arbitrary open- 
system dynamics, including arbitrary Markovian Lind- 
blad evolutions, based on a few simple operations. 

To analyze closed-loop control, we need to describe 
quantum measurements. Quantum measurement is a 
special case of an open-system time evolution. A gen- 
eralized quantum measurement can always be described 



by letting the system to be measured interact with an 
auxiliary environment (or ancilla) and then performing 
a conventional von Neumann measurement on the latter 
|l2| . In terms of Kraus operators, a generalized mea- 
surement corresponds to a set of operators Akm such 
that J2km^km^km = 1- Supposc that the state of S 
is ps as above. The measurement then gives the result 
k with probability pk = tr^)™ ^fcmPs^Im, leaving S in 
the state pk = J2m ^kmPs^l^/pk- The information that 
can be gathered about a quantum system is maximized 
for so-called "pure" measurements , in which case 

a single value value of m occurs. We will restrict to pure 
measurements henceforth. 

A particularly interesting class of pure measurements 
occurs when the Kraus operators are positive (hence Her- 
mitian). Such measurements, which can be realized by 
coupling the system to a suitable "pointer variable" of 
the measuring apparatus, are the "least disturbing" mea- 
surements that can be effected on S As such, they 
supply a natural analogue of von Neumann's model of 
projective measurements. Suppose that one can perform 
such a generalized measurement corresponding to a set of 
positive operators Bk, and feed back the results by apply- 
ing a coherent transformation Uk when the fc-th outcome 
is found. The net effect on the system is to apply the 
transformation 

Ps^Y.^'^^kPsBiul (3) 
fe 

That is, feedback gives rise to an open-system opera- 
tion corresponding to Kraus operators Ak = UkBk- But, 
from the polar decomposition theorem, any operator can 

be written Ak — Uk\Ak\, where \Ak\ — \J A\Ak is pos- 
itive and Uk is defined to be 1 on the kernel /C of Ak 
and on the orthogonal subspace K.^ [Q. As 

a consequence, the ability to make a generalized mea- 
surement corresponding to an arbitrary positive opera- 
tor together with the ability to apply an arbitrary 
coherent unitary transformation conditioned on the re- 
sult of that measurement {Uk), allows one to enact an 
arbitrary open-system operation [Ak — Uk\Ak\). 

The polar decomposition provides a natural separation 
of a general quantum operation in terms of a measure- 
ment step, followed by a feedback step. This decom- 
position, which has been implicitly used throughout the 
history of quantum measurement [p]j7[p^, has recently 
proven useful to investigate the trade-off between in- 
formation and disturbance in quantum feedback control 
|]l5| . In our context, since we have assumed the ability 
to build up arbitrary coherent transformations, we need 
only to find a way to perform measurements correspond- 
ing to arbitrary positive operators in order to enact an 
arbitrary open-system time evolution. 

Consider the simplest possible example of a quantum 
measurement, a so-called "Yes- No" measurement [Q in 
which the measurement apparatus M consists of a single 
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two-level quantum system with states |0), |1). Assume 
that pm = |0)(0| initially, and couple the system to the 
apparatus via an interaction Hamiltonian H — jX (g) Y, 
where 7 > is a coupling constant, and X, Y are Her- 
mitian operators acting on S, M respectively. We choose 
X to be a positive operator projecting onto a pure state 
of S, and let Y = |0)(1| + |1)(0| = a^. The state of the 
system and apparatus after they interact for a time t is 

PSAiit) = ( cos{-ftX) - i sm{-ftX) (g) cr^)ps PM 

( cos(7tX) + i sin(7tX) (g) a^) ■ (4) 

Now make a von Neumann measurement of 0, 1 on the 
ancilla. The result occurs with probability po = 
tr cos^(7iX)p5, in which case S is in the state po — 
cos{'jtX)ps cos{'ytX) /pq. The result 1 occurs with prob- 
ability pi — trsin^ {'ytX)ps, leaving S in the state pi = 
sm{jtX)pssm{jtX)/pi. In other words, this Yes-No 
measurement corresponds to Hermitian Kraus operators 
cos{jtX) , sm{-ftX) . 

The ability to perform arbitrary coherent transforma- 
tions on the system can now be used to transform this 
simple Yes-No measurement into an arbitrary Yes-No 
measurement. This can be accomplished by applying an 
average Hamiltonian technique during the system's 
coupling to the auxiliary quantum system in the course 
of the measurement. Before the von Neumann measure- 
ment is made on the ancilla, perform the following se- 
quence of rapid coherent transformations on the system: 
Apply a unitary transformation Vi, wait for a time Ai, 
then perform the transformation Vi ; now apply a second 
transformation V2, wait for a time A2, and perform the 
transformation V2 ; etc., for N periods. Assume that the 
Vi 's are effected on a time scale short compared with the 
Ai, and let Y^i^i = ^t. Repeat N = t/At times. If N 
is large, then to lowest order in At the net effect of these 
repeated transformations is to replace X in Eq. by 
X = E.(A./Ai)V-/XT/,. 

Starting from a given projector X onto a pure state, 
any positive operator with unit trace can be written in 
the form X for some Vi, Ai > 0. But with an appropriate 
choice of the operator X, and the parameters 7, t, any 
pair of positive Kraus operators can be represented in the 
form Bq = cos{'ytX), Bi = sin(7tAr). So our simple mea- 
surement procedure together with the ability to perform 
coherent control translates into the ability to make arbi- 
trary two-outcome minimally disturbing measurements. 

Now add feedback. Performing the von Neumann mea- 
surement on the ancilla and feeding back the result of of 
the measurement by applying Uq if the result is and 
Ui if the result is 1 gives an open-system time evolution 
ps ^ A^psAq + AipsA\^, where Aq — Uocos{-^tx) and 
Ai = Ui sin(7tX). But, by polar decomposition, any set 
of two Kraus operators can be written in this form. As a 
result, the ability to perform coherent control combined 
with the ability to perform a single, simple measurement 
on the system translates into the ability to enact an ar- 
bitrary two-operator open-system time evolution. 



Generalized measurements with more than two out- 
comes can be constructed in a straightforward way [Q. 
For example, if one can make measurements correspond- 
ing to arbitrary Aq, Ai, a measurement corresponding to 
arbitrary Hermitian Bo,Bi,B2, with Bq + Bf + B2 = 1, 
can be enacted as follows. Perform a measurement cor- 
responding to Bo,B[ — B\ A- _B|. If the result of 
this measurement is 0, do nothing. If the result of this 
measurement is 1, perform a second measurement cor- 
responding to Aq = BiB[~^ , Ai = B2B[~^ (note that 
B[ ~ is well-defined on the set of states that result when 
the first measurement has outcome 1). This measure- 
ment is generally not Hermitian, but the previous para- 
graph shows that we can do arbitrary generalized mea- 
surements with two outcomes. The outcome then cor- 
responds to Bq, the outcome 10 corresponds to Bi, and 
the outcome 11 corresponds to -62- Arbitrary measure- 
ments with multiple (possibly non-Hermitian) outcomes 
can be built up by allowing feedback and by following an 
analogous procedure. 

To summarize, the ability to perform a single simple 
measurement on the system, together with the ability 
to apply coherent control to feed back the measurement 
results, allows one to enact an arbitrary finite-time open- 
system evolution ps 1— > J2k ^fePs^I- 

Now turn to the case of infinitesimal open-system time 
evolutions governed by the Lindblad equation. To ad- 
dress infinitesimal time evolutions, we can imagine that 
the interaction between the system and the ancilla repre- 
senting the measurement apparatus only takes place for a 
short period of time. Accordingly, the unitary propagator 
exp(— jiJt) evolving the system and apparatus together 
can be expanded to second order in time. By writing 
H — J X (^Y a.s above, one gets 

PsAiit) = Ps<» Pm - ilt{Xps ® YpM - PsX ® pmY) 
- ^ {X'^ps ® Y^pM - 2XpsX ® YpmY 
+ psX^ ® pmY^) . (5) 

The time evolution for the system on its own is obtained 
by tracing over the measurement apparatus and taking 
the small-time limit {i.e., t small but finite |17|). This 
results in the Lindblad equation for the system. 



dps 
dt 



[X, ps] - b [X^ps - 2XpsX + psX^), (6) 



where a = ^IvmYpm — and b = {j^t/2) ItmY^ pM — 
7^i/2 for Pm ~ |0)(0|, Y = ax- That is, comparing with 
(0) , the simple coupling above results in a single Lindblad 
operator L = ^/2bX. 

To complete the infinitesimal measurement and feed 
back the classical information, continue just as in the 
non-infinitesimal case, by making a von Neumann mea- 
surement on the auxiliary system. If the result is 0, do 
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nothing; if the result is 1, apply the coherent transforma- 
tion U to S. By using Eq. (^) and tracing over M, the 
resulting state of the system is 



2j-2 



Ps{t) = PS 



{X'^ps - 2UXpsXU^ + psX^) . (7) 



In the small-time limit, this gives rise to a Lindblad equa- 
tion (1) with L = VtbUX. That is, feeding back the 
result of the infinitesimal measurement yields a Lindblad 
equation with a single Lindblad operator proportional to 
UX, where X is a unit-trace positive operator and U is 
of our choosing. 

The average Hamiltonian techniques described above 
can now be used to construct an infinitesimal measure- 
ment corresponding to an arbitrary positive operator X. 
Here, care must be taken to insure that the sequence 
of average Hamiltonian operations Vi can be performed 
within the small "coarse-graining" time t above. Note 
that what is important in the derivation of the Lindblad 
equation (||) is not that t be small but rather that be 
small: accordingly, even though the relevant control time 
scale At is not vanishingly small, 7 can always be made 
sufhciently small that the averaging operations can be fit 
within a time t for which the derivation holds. Feeding 
back the results of the measurement allows one to en- 
act a Lindblad equation governed by an arbitrary single 
Lindblad operator L = \/2bUX. 

The same conclusion could have been also estab- 
lished directly from the ability to implement arbitrary 
two-operator open-system evolutions. In fact, in the 
small-time limit discussed above, the quantum opera- 
tion specified hy_A„ = Uocos{jtX) ~ 1 - {-/'^t'^ /2)x'^ , 
Ai = Uism{-/tX) ~ jtUiX, with Uq ^ t,Ui ^ U, is 
formally equivalent to the Lindblad equation (^) with 
L = y/2bUX. In terms of the matrix A appearing in (|^), 
the ability to generate an arbitrary Lindblad operator 
L — CiFi, Ci G C, translates into the ability to gener- 
ate any rank-one matrix A — {c^c*} As noted above, 
Lindblad equations with multiple Lk can be enacted by 
performing the operations corresponding to each of the 
Lfc in succession. So by making a simple infinitesimal 
measurement, manipulating it by average Hamiltonian 
techniques, and coherently feeding back the results of 
the measurement, one can enact in principle an arbitrary 
Lindblad equation. The enactment is scaled in time, stro- 
boscopic, and approximate, but the scaled time interval 
of the stroboscopic evolution and the error in the approx- 
imation can be made as small as possible by increasing 
the number of control operations per step. 

In conclusion, coherent control combined with feed- 
back allows one to enact an arbitrary open quantum sys- 
tem dynamics. In contrast to the case of closed quan- 
tum systems, in which an arbitrary Hamiltonian time 
evolution can be enacted using only a few open-loop op- 
erations, the open-loop control of open-system dynam- 
ics requires in general an infinite repertoire of indepen- 
dent operations. But closing the loop and feeding back 



the results of the measurements allows any desired open- 
system transformation to be enacted using only the co- 
herent tools required for Hamiltonian control together 
with a single, simple quantum measurement. The ability 
to implement a similar control strategy in the appropri- 
ate small-time limit allows the construction of any de- 
sired continuous-time Markovian evolution described by 
a Lindblad master equation as well. 
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